Pandas Profiling Report

Dataset statistics

Number of variables	16
Number of observations	4384
Missing cells	2668
Missing cells (%)	3.8%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	369.6 KiB
Average record size in memory	86.3 B

Variable types

Numeric	11
Categorical	5

Alerts

`sqft_basement` is highly correlated with `grade` and 5 other fields	High correlation
`bathrooms` is highly correlated with `grade` and 4 other fields	High correlation
`bedrooms` is highly correlated with `sqft_basement` and 4 other fields	High correlation
`sqft_above` is highly correlated with `grade` and 7 other fields	High correlation
`sqft_living15` is highly correlated with `grade` and 4 other fields	High correlation
`floors` is highly correlated with `bedrooms` and 2 other fields	High correlation
`price` is highly correlated with `grade` and 3 other fields	High correlation
`sqft_living` is highly correlated with `grade` and 7 other fields	High correlation
`waterfront` is highly correlated with `view`	High correlation
`sqft_lot` is highly correlated with `sqft_lot15`	High correlation
`sqft_lot15` is highly correlated with `sqft_lot`	High correlation
`view` is highly correlated with `waterfront`	High correlation
`grade` is highly correlated with `sqft_basement` and 5 other fields	High correlation
`sqft_basement` has 2668 (60.9%) missing values	Missing
`level_0` has unique values	Unique
`df_index` has unique values	Unique

Reproduction

Analysis started	2022-09-23 03:35:23.200510
Analysis finished	2022-09-23 03:35:44.997995
Duration	21.8 seconds
Software version	pandas-profiling v3.3.0
Download configuration	config.json

level_0
Real number (ℝ_≥0)

UNIQUE

Distinct	4384
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	18655.07596

Minimum	14
Maximum	111906
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	14
5-th percentile	1162.6
Q1	6274
median	14059
Q3	26827.25
95-th percentile	52819.9
Maximum	111906
Range	111892
Interquartile range (IQR)	20553.25

Descriptive statistics

Standard deviation	16323.09487
Coefficient of variation (CV)	0.8749948224
Kurtosis	1.795466893
Mean	18655.07596
Median Absolute Deviation (MAD)	9398
Skewness	1.336983306
Sum	81783853
Variance	266443426.3
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
32828	1	< 0.1%
3563	1	< 0.1%
3597	1	< 0.1%
19312	1	< 0.1%
27672	1	< 0.1%
26790	1	< 0.1%
48844	1	< 0.1%
26971	1	< 0.1%
10676	1	< 0.1%
10885	1	< 0.1%
Other values (4374)	4374	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
14	1	< 0.1%
15	1	< 0.1%
18	1	< 0.1%
20	1	< 0.1%
27	1	< 0.1%
29	1	< 0.1%
30	1	< 0.1%
31	1	< 0.1%
41	1	< 0.1%
42	1	< 0.1%

Value	Count	Frequency (%)
111906	1	< 0.1%
93792	1	< 0.1%
91932	1	< 0.1%
91673	1	< 0.1%
85147	1	< 0.1%
85126	1	< 0.1%
83869	1	< 0.1%
83788	1	< 0.1%
83746	1	< 0.1%
82990	1	< 0.1%

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	4384
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10927.9391

Minimum	1
Maximum	21985
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1212.75
Q1	5473.5
median	10775.5
Q3	16344.75
95-th percentile	20852.85
Maximum	21985
Range	21984
Interquartile range (IQR)	10871.25

Descriptive statistics

Standard deviation	6280.36
Coefficient of variation (CV)	0.5747067168
Kurtosis	-1.189728993
Mean	10927.9391
Median Absolute Deviation (MAD)	5441
Skewness	0.03233114678
Sum	47908085
Variance	39442921.72
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
6159	1	< 0.1%
9779	1	< 0.1%
20601	1	< 0.1%
11440	1	< 0.1%
12820	1	< 0.1%
5804	1	< 0.1%
15943	1	< 0.1%
1665	1	< 0.1%
20723	1	< 0.1%
201	1	< 0.1%
Other values (4374)	4374	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
19	1	< 0.1%
23	1	< 0.1%
28	1	< 0.1%
41	1	< 0.1%
43	1	< 0.1%
58	1	< 0.1%
60	1	< 0.1%
61	1	< 0.1%
67	1	< 0.1%

Value	Count	Frequency (%)
21985	1	< 0.1%
21976	1	< 0.1%
21971	1	< 0.1%
21968	1	< 0.1%
21965	1	< 0.1%
21964	1	< 0.1%
21963	1	< 0.1%
21951	1	< 0.1%
21947	1	< 0.1%
21944	1	< 0.1%

grade
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	11
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.65419708

Minimum	3
Maximum	13
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	3
5-th percentile	6
Q1	7
median	7
Q3	8
95-th percentile	10
Maximum	13
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.178149492
Coefficient of variation (CV)	0.153922022
Kurtosis	1.079601273
Mean	7.65419708
Median Absolute Deviation (MAD)	1
Skewness	0.7624781624
Sum	33556
Variance	1.388036225
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
7	1828	41.7%
8	1228	28.0%
9	508	11.6%
6	407	9.3%
10	254	5.8%
11	76	1.7%
5	60	1.4%
12	16	0.4%
13	3	0.1%
4	3	0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
3	1	< 0.1%
4	3	0.1%
5	60	1.4%
6	407	9.3%
7	1828	41.7%
8	1228	28.0%
9	508	11.6%
10	254	5.8%
11	76	1.7%
12	16	0.4%

Value	Count	Frequency (%)
13	3	0.1%
12	16	0.4%
11	76	1.7%
10	254	5.8%
9	508	11.6%
8	1228	28.0%
7	1828	41.7%
6	407	9.3%
5	60	1.4%
4	3	0.1%

sqft_basement
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	202
Distinct (%)	11.8%
Missing	2668
Missing (%)	60.9%
Infinite	0
Infinite (%)	0.0%
Mean	741.6491841

Minimum	10
Maximum	3480
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	10
5-th percentile	190
Q1	450
median	700
Q3	970
95-th percentile	1452.5
Maximum	3480
Range	3470
Interquartile range (IQR)	520

Descriptive statistics

Standard deviation	399.0579306
Coefficient of variation (CV)	0.53806832
Kurtosis	2.657961737
Mean	741.6491841
Median Absolute Deviation (MAD)	260
Skewness	1.041309076
Sum	1272670
Variance	159247.232
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
700	49	1.1%
600	47	1.1%
500	47	1.1%
400	36	0.8%
800	35	0.8%
900	33	0.8%
300	32	0.7%
1000	31	0.7%
620	25	0.6%
1100	22	0.5%
Other values (192)	1359	31.0%
(Missing)	2668	60.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
10	1	< 0.1%
20	1	< 0.1%
40	1	< 0.1%
60	1	< 0.1%
70	3	0.1%
80	5	0.1%
90	2	< 0.1%
100	9	0.2%
110	3	0.1%
120	3	0.1%

Value	Count	Frequency (%)
3480	1	< 0.1%
3260	1	< 0.1%
2730	1	< 0.1%
2330	1	< 0.1%
2220	2	< 0.1%
2160	1	< 0.1%
2150	1	< 0.1%
2100	1	< 0.1%
2060	1	< 0.1%
2040	1	< 0.1%

view
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.6 KiB

0.0	3966
2.0	189
3.0	90
1.0	72
4.0	67

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	13152
Distinct characters	6
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0.0
2nd row	0.0
3rd row	0.0
4th row	0.0
5th row	0.0

Common Values

Value	Count	Frequency (%)
0.0	3966	90.5%
2.0	189	4.3%
3.0	90	2.1%
1.0	72	1.6%
4.0	67	1.5%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0.0	3966	90.5%
2.0	189	4.3%
3.0	90	2.1%
1.0	72	1.6%
4.0	67	1.5%

Most occurring characters

Value	Count	Frequency (%)
0	8350	63.5%
.	4384	33.3%
2	189	1.4%
3	90	0.7%
1	72	0.5%
4	67	0.5%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	8768	66.7%
Other Punctuation	4384	33.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	8350	95.2%
2	189	2.2%
3	90	1.0%
1	72	0.8%
4	67	0.8%

Other Punctuation

Value	Count	Frequency (%)
.	4384	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	13152	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	8350	63.5%
.	4384	33.3%
2	189	1.4%
3	90	0.7%
1	72	0.5%
4	67	0.5%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	13152	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	8350	63.5%
.	4384	33.3%
2	189	1.4%
3	90	0.7%
1	72	0.5%
4	67	0.5%

bathrooms
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	25
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.111656022

Minimum	0.5
Maximum	8
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	0.5
5-th percentile	1
Q1	1.75
median	2.25
Q3	2.5
95-th percentile	3.5
Maximum	8
Range	7.5
Interquartile range (IQR)	0.75

Descriptive statistics

Standard deviation	0.7709681102
Coefficient of variation (CV)	0.3651011823
Kurtosis	1.625505159
Mean	2.111656022
Median Absolute Deviation (MAD)	0.5
Skewness	0.5490073892
Sum	9257.5
Variance	0.5943918269
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=25)

Value	Count	Frequency (%)
2.5	1065	24.3%
1	797	18.2%
1.75	638	14.6%
2.25	423	9.6%
2	392	8.9%
1.5	268	6.1%
2.75	246	5.6%
3.5	158	3.6%
3	154	3.5%
3.25	115	2.6%
Other values (15)	128	2.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.5	1	< 0.1%
0.75	15	0.3%
1	797	18.2%
1.25	4	0.1%
1.5	268	6.1%
1.75	638	14.6%
2	392	8.9%
2.25	423	9.6%
2.5	1065	24.3%
2.75	246	5.6%

Value	Count	Frequency (%)
8	1	< 0.1%
7.5	1	< 0.1%
6	1	< 0.1%
5.75	1	< 0.1%
5.5	1	< 0.1%
5.25	4	0.1%
5	3	0.1%
4.75	5	0.1%
4.5	18	0.4%
4.25	14	0.3%

bedrooms
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	9
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.367244526

Minimum	1
Maximum	9
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	3
median	3
Q3	4
95-th percentile	5
Maximum	9
Range	8
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.9073855097
Coefficient of variation (CV)	0.2694741955
Kurtosis	1.196311618
Mean	3.367244526
Median Absolute Deviation (MAD)	1
Skewness	0.4115450537
Sum	14762
Variance	0.8233484631
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=9)

Value	Count	Frequency (%)
3	1942	44.3%
4	1417	32.3%
2	580	13.2%
5	339	7.7%
1	48	1.1%
6	46	1.0%
7	9	0.2%
9	2	< 0.1%
8	1	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	48	1.1%
2	580	13.2%
3	1942	44.3%
4	1417	32.3%
5	339	7.7%
6	46	1.0%
7	9	0.2%
8	1	< 0.1%
9	2	< 0.1%

Value	Count	Frequency (%)
9	2	< 0.1%
8	1	< 0.1%
7	9	0.2%
6	46	1.0%
5	339	7.7%
4	1417	32.3%
3	1942	44.3%
2	580	13.2%
1	48	1.1%

sqft_above
Real number (ℝ)

HIGH CORRELATION

Distinct	490
Distinct (%)	11.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4.641866777 × 10^-15

Minimum	-3.727374881
Maximum	3.332527561
Zeros	0
Zeros (%)	0.0%
Negative	2256
Negative (%)	51.5%
Memory size	34.4 KiB

Quantile statistics

Minimum	-3.727374881
5-th percentile	-1.607801805
Q1	-0.6910411929
median	-0.04132922053
Q3	0.7417632297
95-th percentile	1.638361521
Maximum	3.332527561
Range	7.059902442
Interquartile range (IQR)	1.432804423

Descriptive statistics

Standard deviation	1.000114071
Coefficient of variation (CV)	2.154551431 × 10¹⁴
Kurtosis	-0.4310489928
Mean	4.641866777 × 10^-15
Median Absolute Deviation (MAD)	0.7145397924
Skewness	0.01502063272
Sum	2.052602532 × 10^-11
Variance	1.000228154
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-0.648923129	46	1.0%
-0.5079561283	44	1.0%
-0.4885892409	44	1.0%
-0.5275090924	41	0.9%
-0.5873174791	41	0.9%
-1.14007613	41	0.9%
-0.8686060571	40	0.9%
-0.4129199988	39	0.9%
-0.8002375118	39	0.9%
-0.6910411929	39	0.9%
Other values (480)	3970	90.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-3.727374881	1	< 0.1%
-3.365516593	1	< 0.1%
-3.048229641	1	< 0.1%
-2.989276226	1	< 0.1%
-2.931677658	1	< 0.1%
-2.875378607	1	< 0.1%
-2.820326953	1	< 0.1%
-2.766473551	3	0.1%
-2.713772009	1	< 0.1%
-2.662178491	3	0.1%

Value	Count	Frequency (%)
3.332527561	1	< 0.1%
3.195909343	1	< 0.1%
2.759333801	1	< 0.1%
2.682767393	1	< 0.1%
2.633523084	1	< 0.1%
2.576030954	1	< 0.1%
2.536394404	1	< 0.1%
2.471346726	1	< 0.1%
2.464328599	1	< 0.1%
2.432326295	1	< 0.1%

sqft_living15
Real number (ℝ)

HIGH CORRELATION

Distinct	441
Distinct (%)	10.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4.953053377 × 10^-15

Minimum	-3.362638675
Maximum	3.0395625
Zeros	0
Zeros (%)	0.0%
Negative	2246
Negative (%)	51.2%
Memory size	34.4 KiB

Quantile statistics

Minimum	-3.362638675
5-th percentile	-1.623301191
Q1	-0.6838419449
median	-0.04577950829
Q3	0.7214310906
95-th percentile	1.678594989
Maximum	3.0395625
Range	6.402201175
Interquartile range (IQR)	1.405273036

Descriptive statistics

Standard deviation	1.000114071
Coefficient of variation (CV)	2.019186943 × 10¹⁴
Kurtosis	-0.3126481893
Mean	4.953053377 × 10^-15
Median Absolute Deviation (MAD)	0.7048474896
Skewness	0.00982565812
Sum	2.173250468 × 10^-11
Variance	1.000228154
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-0.4527809029	44	1.0%
-0.5552350382	43	1.0%
-0.3932329145	39	0.9%
-0.5973941259	39	0.9%
-0.2409912255	38	0.9%
-0.6402560308	37	0.8%
-0.8191699747	37	0.8%
-0.9375465243	37	0.8%
-0.3542993058	37	0.8%
-0.796121902	36	0.8%
Other values (431)	3997	91.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-3.362638675	1	< 0.1%
-3.199167786	1	< 0.1%
-3.146516512	1	< 0.1%
-3.043810473	2	< 0.1%
-2.848104606	2	< 0.1%
-2.810418974	1	< 0.1%
-2.801069902	2	< 0.1%
-2.754750714	3	0.1%
-2.70912784	1	< 0.1%
-2.664182814	2	< 0.1%

Value	Count	Frequency (%)
3.0395625	2	< 0.1%
2.85312905	1	< 0.1%
2.749932018	1	< 0.1%
2.731380489	1	< 0.1%
2.660115583	2	< 0.1%
2.580984029	2	< 0.1%
2.55043147	1	< 0.1%
2.5349683	1	< 0.1%
2.514152817	2	< 0.1%
2.493107041	1	< 0.1%

waterfront
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.5 KiB

0.0	4349
1.0	35

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	13152
Distinct characters	3
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	0.0
2nd row	0.0
3rd row	0.0
4th row	0.0
5th row	0.0

Common Values

Value	Count	Frequency (%)
0.0	4349	99.2%
1.0	35	0.8%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
0.0	4349	99.2%
1.0	35	0.8%

Most occurring characters

Value	Count	Frequency (%)
0	8733	66.4%
.	4384	33.3%
1	35	0.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	8768	66.7%
Other Punctuation	4384	33.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	8733	99.6%
1	35	0.4%

Other Punctuation

Value	Count	Frequency (%)
.	4384	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	13152	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	8733	66.4%
.	4384	33.3%
1	35	0.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	13152	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	8733	66.4%
.	4384	33.3%
1	35	0.3%

floors
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	6
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.484260949

Minimum	1
Maximum	3.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	34.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	2
95-th percentile	2
Maximum	3.5
Range	2.5
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.5388011141
Coefficient of variation (CV)	0.3630096948
Kurtosis	-0.4517018207
Mean	1.484260949
Median Absolute Deviation (MAD)	0
Skewness	0.6502545024
Sum	6507
Variance	0.2903066405
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=6)

Value	Count	Frequency (%)
1	2207	50.3%
2	1631	37.2%
1.5	390	8.9%
3	124	2.8%
2.5	31	0.7%
3.5	1	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2207	50.3%
1.5	390	8.9%
2	1631	37.2%
2.5	31	0.7%
3	124	2.8%
3.5	1	< 0.1%

Value	Count	Frequency (%)
3.5	1	< 0.1%
3	124	2.8%
2.5	31	0.7%
2	1631	37.2%
1.5	390	8.9%
1	2207	50.3%

sqft_lot
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.6 KiB

2.0	1967
1.0	1106
3.0	725
4.0	320
0.0	266

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	13152
Distinct characters	6
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2.0
2nd row	0.0
3rd row	1.0
4th row	2.0
5th row	4.0

Common Values

Value	Count	Frequency (%)
2.0	1967	44.9%
1.0	1106	25.2%
3.0	725	16.5%
4.0	320	7.3%
0.0	266	6.1%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
2.0	1967	44.9%
1.0	1106	25.2%
3.0	725	16.5%
4.0	320	7.3%
0.0	266	6.1%

Most occurring characters

Value	Count	Frequency (%)
0	4650	35.4%
.	4384	33.3%
2	1967	15.0%
1	1106	8.4%
3	725	5.5%
4	320	2.4%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	8768	66.7%
Other Punctuation	4384	33.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	4650	53.0%
2	1967	22.4%
1	1106	12.6%
3	725	8.3%
4	320	3.6%

Other Punctuation

Value	Count	Frequency (%)
.	4384	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	13152	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	4650	35.4%
.	4384	33.3%
2	1967	15.0%
1	1106	8.4%
3	725	5.5%
4	320	2.4%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	13152	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	4650	35.4%
.	4384	33.3%
2	1967	15.0%
1	1106	8.4%
3	725	5.5%
4	320	2.4%

price
Real number (ℝ)

HIGH CORRELATION

Distinct	1550
Distinct (%)	35.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.519498234 × 10^-13

Minimum	-4.669290356
Maximum	2.901084695
Zeros	0
Zeros (%)	0.0%
Negative	2052
Negative (%)	46.8%
Memory size	34.4 KiB

Quantile statistics

Minimum	-4.669290356
5-th percentile	-1.626419319
Q1	-0.6054377704
median	0.05071254471
Q3	0.6217544233
95-th percentile	1.37058292
Maximum	2.901084695
Range	7.570375051
Interquartile range (IQR)	1.227192194

Descriptive statistics

Standard deviation	1.000114071
Coefficient of variation (CV)	6.581870571 × 10¹²
Kurtosis	1.346485739
Mean	1.519498234 × 10^-13
Median Absolute Deviation (MAD)	0.6078048319
Skewness	0.02751371968
Sum	6.662377317 × 10^-10
Variance	1.000228154
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-0.4194142735	43	1.0%
0.05071254471	41	0.9%
-0.283154233	36	0.8%
-0.5722534461	35	0.8%
0.3056373027	34	0.8%
-0.1607388537	31	0.7%
0.2275078256	30	0.7%
-1.171905929	30	0.7%
0.01152250914	29	0.7%
0.1428447777	28	0.6%
Other values (1540)	4047	92.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-4.669290356	1	< 0.1%
-3.971919452	1	< 0.1%
-3.952250909	1	< 0.1%
-3.800094941	2	< 0.1%
-3.752541505	1	< 0.1%
-3.656568595	1	< 0.1%
-3.621943352	1	< 0.1%
-3.39868964	1	< 0.1%
-3.392426911	1	< 0.1%
-3.361358723	1	< 0.1%

Value	Count	Frequency (%)
2.901084695	1	< 0.1%
2.898108224	1	< 0.1%
2.898078954	1	< 0.1%
2.898056904	1	< 0.1%
2.897777884	1	< 0.1%
2.897609474	1	< 0.1%
2.897415704	1	< 0.1%
2.897082667	1	< 0.1%
2.89665688	1	< 0.1%
2.896333475	1	< 0.1%

condition
Categorical

Distinct	5
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.6 KiB

3.0	2884
4.0	1112
5.0	346
2.0	35
1.0	7

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	13152
Distinct characters	7
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	3.0
2nd row	3.0
3rd row	3.0
4th row	3.0
5th row	3.0

Common Values

Value	Count	Frequency (%)
3.0	2884	65.8%
4.0	1112	25.4%
5.0	346	7.9%
2.0	35	0.8%
1.0	7	0.2%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
3.0	2884	65.8%
4.0	1112	25.4%
5.0	346	7.9%
2.0	35	0.8%
1.0	7	0.2%

Most occurring characters

Value	Count	Frequency (%)
.	4384	33.3%
0	4384	33.3%
3	2884	21.9%
4	1112	8.5%
5	346	2.6%
2	35	0.3%
1	7	0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	8768	66.7%
Other Punctuation	4384	33.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	4384	50.0%
3	2884	32.9%
4	1112	12.7%
5	346	3.9%
2	35	0.4%
1	7	0.1%

Other Punctuation

Value	Count	Frequency (%)
.	4384	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	13152	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
.	4384	33.3%
0	4384	33.3%
3	2884	21.9%
4	1112	8.5%
5	346	2.6%
2	35	0.3%
1	7	0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	13152	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
.	4384	33.3%
0	4384	33.3%
3	2884	21.9%
4	1112	8.5%
5	346	2.6%
2	35	0.3%
1	7	0.1%

sqft_lot15
Categorical

HIGH CORRELATION

Distinct	5
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	4.6 KiB

2.0	1890
1.0	1295
3.0	658
4.0	294
0.0	247

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	13152
Distinct characters	6
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2.0
2nd row	1.0
3rd row	1.0
4th row	2.0
5th row	0.0

Common Values

Value	Count	Frequency (%)
2.0	1890	43.1%
1.0	1295	29.5%
3.0	658	15.0%
4.0	294	6.7%
0.0	247	5.6%

Length

Histogram of lengths of the category

Category Frequency Plot

Value	Count	Frequency (%)
2.0	1890	43.1%
1.0	1295	29.5%
3.0	658	15.0%
4.0	294	6.7%
0.0	247	5.6%

Most occurring characters

Value	Count	Frequency (%)
0	4631	35.2%
.	4384	33.3%
2	1890	14.4%
1	1295	9.8%
3	658	5.0%
4	294	2.2%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	8768	66.7%
Other Punctuation	4384	33.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	4631	52.8%
2	1890	21.6%
1	1295	14.8%
3	658	7.5%
4	294	3.4%

Other Punctuation

Value	Count	Frequency (%)
.	4384	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	13152	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	4631	35.2%
.	4384	33.3%
2	1890	14.4%
1	1295	9.8%
3	658	5.0%
4	294	2.2%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	13152	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	4631	35.2%
.	4384	33.3%
2	1890	14.4%
1	1295	9.8%
3	658	5.0%
4	294	2.2%

sqft_living
Real number (ℝ)

HIGH CORRELATION

Distinct	539
Distinct (%)	12.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.306357621 × 10^-15

Minimum	-3.467099061
Maximum	4.560854687
Zeros	0
Zeros (%)	0.0%
Negative	2157
Negative (%)	49.2%
Memory size	34.4 KiB

Quantile statistics

Minimum	-3.467099061
5-th percentile	-1.644378586
Q1	-0.6860623492
median	0.0006779349509
Q3	0.7012017549
95-th percentile	1.636738313
Maximum	4.560854687
Range	8.027953748
Interquartile range (IQR)	1.387264104

Descriptive statistics

Standard deviation	1.000114071
Coefficient of variation (CV)	3.024821224 × 10¹⁴
Kurtosis	-0.1788791482
Mean	3.306357621 × 10^-15
Median Absolute Deviation (MAD)	0.695762459
Skewness	-0.001090873618
Sum	1.451372356 × 10^-11
Variance	1.000228154
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0006779349509	37	0.8%
-0.1013106765	36	0.8%
-0.6532734636	35	0.8%
-0.3188469686	34	0.8%
-0.928786359	33	0.8%
-0.8925991982	33	0.8%
-0.4956003819	31	0.7%
-0.2076844466	30	0.7%
-0.2350091553	30	0.7%
-0.6696130404	29	0.7%
Other values (529)	4056	92.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-3.467099061	1	< 0.1%
-3.216474217	1	< 0.1%
-2.990143759	1	< 0.1%
-2.947386253	1	< 0.1%
-2.905393143	1	< 0.1%
-2.82359188	1	< 0.1%
-2.783733159	1	< 0.1%
-2.705982749	2	< 0.1%
-2.668047835	2	< 0.1%
-2.557766551	1	< 0.1%

Value	Count	Frequency (%)
4.560854687	1	< 0.1%
3.480484386	1	< 0.1%
3.425531017	1	< 0.1%
3.200574403	1	< 0.1%
3.000974718	1	< 0.1%
2.997130821	1	< 0.1%
2.879099132	1	< 0.1%
2.793176562	1	< 0.1%
2.738528811	1	< 0.1%
2.725753	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	level_0	df_index	grade	sqft_basement	bathrooms	bedrooms	sqft_above	sqft_living15	floors	sqft_lot	price	condition	sqft_lot15	sqft_living
0	32828	6159	8.0	NaN	2.25	3.0	0.270630	0.347140	1.0	2.0	-0.745215	3.0	2.0	-0.153925
1	6012	17829	8.0	NaN	2.50	3.0	-0.394437	-1.036220	3.0	0.0	0.149879	3.0	1.0	-0.804412
2	34920	5581	8.0	NaN	3.00	4.0	0.987378	0.841629	2.0	1.0	0.227508	3.0	1.0	0.607272
3	923	338	7.0	NaN	1.75	3.0	-0.269616	-0.204335	1.0	2.0	-1.030388	3.0	2.0	-0.686062
4	9859	13944	7.0	240.0	1.00	2.0	-0.734034	-0.705913	1.0	4.0	-0.363089	3.0	0.0	-0.686062
5	13488	10035	9.0	NaN	2.50	4.0	0.658856	0.487815	2.0	2.0	0.701140	3.0	2.0	0.250012
6	15973	21915	7.0	1100.0	1.75	4.0	-0.915452	-0.472945	1.0	2.0	-0.283154	5.0	1.0	0.349666
7	24265	11524	10.0	NaN	3.00	3.0	1.387071	1.043055	2.0	4.0	0.963712	3.0	3.0	1.062741
8	29055	135	7.0	NaN	1.75	3.0	-0.450401	-0.576228	1.0	3.0	-1.776634	4.0	3.0	-0.856941
9	2550	7404	11.0	NaN	3.50	4.0	2.117412	0.721431	2.0	2.0	1.584642	3.0	2.0	1.961547

Last rows

	level_0	df_index	grade	sqft_basement	bathrooms	bedrooms	sqft_above	sqft_living15	floors	sqft_lot	price	condition	sqft_lot15	sqft_living
4374	26684	21235	8.0	NaN	2.75	4.0	1.621179	0.432551	2.0	2.0	0.683450	3.0	2.0	1.340982
4375	48630	8832	7.0	NaN	2.00	4.0	0.648220	-0.240991	1.0	3.0	0.227508	4.0	2.0	0.238689
4376	59966	8352	7.0	800.0	1.00	3.0	-0.041329	-0.297005	1.0	1.0	0.326452	3.0	1.0	0.517561
4377	38623	2641	11.0	NaN	2.75	4.0	1.546773	2.183899	2.0	3.0	2.890096	3.0	3.0	1.251589
4378	9343	9394	8.0	NaN	2.50	3.0	0.605043	-1.327956	2.0	2.0	0.951100	3.0	2.0	0.192875
4379	14375	11832	7.0	NaN	2.00	3.0	-0.648923	-0.534413	1.0	2.0	-1.172895	3.0	2.0	-1.040688
4380	29775	11830	7.0	800.0	2.00	3.0	-0.822780	0.135037	1.0	3.0	-0.165398	3.0	3.0	0.050140
4381	5801	13137	7.0	1220.0	1.75	3.0	-0.322161	0.432551	1.0	4.0	-0.267780	3.0	4.0	0.759237
4382	16610	2584	7.0	NaN	1.50	3.0	-0.412920	-0.432776	1.0	2.0	-0.222811	3.0	2.0	-0.821796
4383	235	9683	6.0	NaN	1.00	2.0	-1.420574	-0.728174	1.0	1.0	0.050713	4.0	1.0	-1.719006

Overview

Variables

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Other Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Other Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Other Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Other Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Category Frequency Plot

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Other Punctuation

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values